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ABSTRACT 


A  imified  method  of  analysis  for  factorial  arrangements  in 
block  designs  has  been  developed  for  arbitrary  block  designs.  The 
main  results  shown  here  are  (1)  an  easy  way  to  determine  the  de¬ 
grees  of  freedom  for  treatments,  <2)  a  systematic  ^proach  to  find 
a  set  of  estimable  effects,  and  <3)  in  the  factorial  case,  a  method 
to  determine  which  effects  are  confounded  with  blocks  or  aliased 
with  other  effects. 
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1.  INTRODUCTION 


This  report  is  the  fifth  effort* using  a  unified  method  of  analysis  for  factorial  ar- 
^emenls  incorporated  into  block  designs.  Four  efforts  were  previously  published  in  various 
j!  -rnals.*  The  first  two  papers  * '  ^  present  the  basic  theory  and  give  solutions  for  a  wide 
class  of  balanced  (hence  connected)  block  designs.  Due  to  certain  desirable  properties  associ¬ 
ated  with  balanced  designs,  these  solutions  con  be  expressed  explicitly  and  require  no  inversion 
of  matrices  to  obtain  the  solutions.  The  third^  treats  the  case  of  two-way  elimination  of 
heterogeneity.  The  fourth^  treats  the  case  involving  unequal  number  of  treatments  per  block 
but  is  restricted  to  the  case  of  designs  with  one  block  only  and  to  the  case  of  complete  factorial 
experiments. 

This  report  extends  the  prior  work  by  providing  solutions  for  arbitrary  block  designs. 
Included  art.  nonconnected  designs  in  general,  the  fractional  factorial  designs,  case  of  miss¬ 
ing  treatments  in  general,  and  unequal  number  of  treatments  per  plot  per  each  of  multiple 
blocks.  In  these  cases,  the  nice  properties  of  balanced  designs  disappear,  and  the  solutions 
to  the  normal  equations  will  sometimes  involve  matrix  inversions  for  the  reduced  solutions. 
Effective  use  of  partitioned  matrices,  and  their  generalized  inverses.  Is  made  in  these  cases. 

In  many  other  cases  the  coefficient  matrix  of  the  normal  equations  is  idempotent;  then  the 
solution  to  the  reduced  normal  equations  is  expressed  explicitly  without  requiring  formal 
matrix  inversion. 

The  main  contributions  of  this  paper  are:  Theorem  1  from  which  the  rank  of  the  coefficient 
matrix  of  the  reduced  normal  equations  can  be  determined  easily  (Section  3.3);  a  systematic 
approach  to  finding  the  estimable  parameters  in  the  non-factorial  case  for  any  block  design 
(Sections  3.4  and  3.5);  and  the  extension  of  tlie  results  to  the  factorial  case  where  the  confounded 
and  aliased  effect  terms  are  determined  in  terms  of  the  estimable  parameters,  (Sections  4.3 
and  4.4). 

There  probably  are  no  new  mathematical  results  herein,  although  some  of  the  results  arc 
hard  to  find  in  any  one  place.  The  known  results  used  by  many  authors,  notably.  Tocher,^ 

Rao,*  Zelen  and  Goldman,^  Graybill,®  Kurkjian  and  Zelan,*’^  Kempihome,®  are  collected 
together  and  used  to  yield  a  reasonably  efficient  computer  program  (FORTRAN  IV)  to  do  the 
analysis.  The  program  requires  for  input  only  the  observed  data  and  the  generalized  incidence 
matrix,  L,  for  the  design. 

Those  designs  with  especially  nice  properties,  of  course,  could  be  solved  with  more  ele¬ 
gant  methods.*’  ^  Even  in  these  cases,  however,  a  computer  program  would  be  desirable  for 


Kurkjion,  B.  ond  Zelen,  M.  (,962)  A  Calculus  for  Foctorial  Arrangements  Ann.  Moth.  Slot.  _33,  609-619. 

^Kurkjian,  B.  end  Zelen,  M.  (1963)  Applicatians  of  the  Calculus  (or  Factoriol  Arrangements  I.  Block  and  Direct 
Product  Designs,  Biometriko  SO,  63-73. 

'Zelen,  M.  ond  Federer,  W.  T.  (1964):  Applications  of  the  Calculus  for  Foctoriol  Arrongements  II.  Designs  with 
Two-way  Elimination  of  Heterogeneity  Ann.  Math-  Stot.  35,  658-672. 

^Zelen,  M.  ond  Federer,  W.  T.  (1966):  Application  cf  the  Calculus  for  Foctoriul  Arrangements  III.  Analysis  of 
of  Factorials  with  Unequal  Numbers  of  Observations,  Sankhya,  {A),_27,  363-400. 

^Tocher,  K.  D.  (1952)  The  Design  ond  Analysis  of  Block  Experiments,  J.  Roy.  Stot.  Soc.,  Ser  B,  45-91. 

"Rao,  C.  R.  (1962)  A  Note  on  o  Generalized  Inverse  of  a  Motrix  With  Applications  to  Problems  in  Mathemoticol 
Statistics.  J.  Roy  Stot.  Soc  (B),_24,  152-158. 

'Zelen,  M.  ond  Goldmon,  A.  J.  (1964);  Weak  Generalized  Inverses  ond  Minimum  Voriance  Linear  Unbiased  Estimo- 
tion.  J.  Res.  Not’l.  Bur.  Stds.  68B,  151-172. 

"Groybill,  F.  A.  (1961)  An  IntreHuction  to  Lineor  Stotisticol  M.odels,  Volume  I,  McGroy-Hill,  New  York. 

^Kempthorne,  0.  (1952)  Design  ond  Anolysis  of  Experiments,  John  Wiley  and  Sons,  New  York. 
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each  type  of  balanced  design  to  do  the  unpleaa.int  arithmetic.  However,  as  frequently  happens 
in  practice,  the  balance  of  a  well  designed  experiment  is  inadvertently  destroyed  at  the  Held 
site  through  loss  of  data,  or  failure  to  follow  the  test  design  for  various  reasons.  !n  tb‘'se 
situationF<  ^he  experimenter  need  not  be  concerned  with  the  synthesis  and  analysis  of  the  re¬ 
sulting  ''  3if,n.  The  data  are  analyzed  as  taken.  The  computer  output  lists  the  complete 
analyser- ' '  variance  together  with  the  estimates  of  the  treatment  parameters,  the  associated 
'  .''xiance-c  ^variance  matrix,  end  the  aliasing  and  confounding  where  appropriate. 

Following  the  introduction  the  paper  is  divided  in  5  parts.  Section  2  contains,  for  complete¬ 
ness,  some  mathematical  tools  to  be  used  in  the  sequel.  Section  3  gives  a  short  review  for  the 
analysis  of  block  designs  to  set  the  stage  for  J-e  main  results  given  in  section  4.  An  outline 
of  the  entire  computations?  procedure  is  given  in  section  5.  Section  5  gives  some  examples. 


2.  MATHEMATICAL.  TOOLS 

F  ’  i  is  section  we  summarize  some  notation  and  operations  which  are  used  in  the  sequel. 
.  >-..ing  specia.  matrices  will  be  used: 

column  vector  of  dimension  m ,  with  all  elements  unity 
J,  =  1,  1,'  a  square  matrix  of  dimension  m,  with  all  e.ement8  unity 
I,  the  unit  matrix  of  dimension  m, 

M,  =m.  1, -J. 

0.  a  column  vector  of  dimension  m  |  with  all  null  elements 

2.1  Direct  Product  (DP)  and  Symbolic  Dlxact  Product  (SDP) 

♦ 

Let  A  =  (ajj )  and  B  =  (b,, )  be  reciungular  matrices  of  dimensions  m  x  n  and  p  x  q, 
respectively.  Then  the  direct  product  (DP),  or  Kronecker  product,  of  A  and  B  will  be  written 
A  X  B  and  is  given  by 


DjjB  DjjB  •  •  •  a,„B 

flji  B  022  B  •  •  •  ■•’a,  B 

’  '\nnB 


with  dimensions  mp  x  nq.  In  general,  if  Aj,  (i  =  1,  2,  . .  .,  k),  are  ra.  x  n.  matrices,  their 
joint  direct  product,  Aj  x  Aj  x  . .  .  x  A,^  have  dimensions 

k  k 

1*1  i"l 
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For  arbitrary  square  matrices,  A,  B,  C,  and  D,  the  direct  product  operation  has  the 
following  basic  properties: 

(A  X  B)  X  C  =  A  X  (B  X  C) 

(A  +  B)  X  C  =  (A  X  C)  +  (B  X  C) 

c  X  A  =  A  X  c  =  cA  for  an  arbitrary  scalar  c 

(A  X  B)'  =  A'  X  B' 

(A  X  B)~*  =  A"*  X  bT*  providing  the  indicated  inverses  exist 

(A  X  B)  (C  X  D)  =  AC  X  BD  provided  the  indicated  products  are  conformable. 

The  symbolic  direct  product  (SDP)  operation  will  be  denoted  by  ®  .  Let 


°i'  =  K  (1).  aj  (2),  •  •  •  .  Hj  (mj)] 

be  row  vectors  for  i  =  1,  2,  .  .  n.  Then  the  SDP  of  Op  and  aq  is  defined  to  be 

ap.dl)  - 

«pq  (12) 


‘Vq  (21) 


0  (2ni„) 

pq  '  q' 


|;;pq  ('^.  -"qy 

The  axtension  of  the  SDP  to  more  than  two  vectors  is  straightforward.  The  SDP  is  an  operation 
on  symbolic  quantities,  but  not  on  numerical  quantities. 


\  (!)■ 

■^q  (1)~ 

°P  S  = 

«p  (2) 

© 

"q  (  2) 

_«p  ("V) 

aq  (%)_ 

As  an  examole,  let  =  2.  Let  (Ij)  denote  the  effect  of  a  two-factor  interaction 

term  when  experimental  factors  and  A^  are  at  levels  i  and  j,  respectively.  Then  a  (x)  a 
will  be  used  in  the  sequel  to  order  the  elements  of  the  two  factor  interaction  as 


%  ®  "q)  '  =  (H)  (12)  Op^  (21)  Op^  (22)]. 

Furthermore,  the  SDP  will  be  used  to  order  the  treatment-combinations  in  a  factorial 
experiment.  For  example,  assume  a  two-factor  axperiment  with  factor  Aj  at  two  levels  and 
factor  Aj  at  three  levels.  Let  'j  =  (1  2)  and  =  (1  2  3)  bs  vectors  whose  elements  denote 
the  levels  of  the  lactors.  Then  the  SDP 


gives  the  ordering  of  the  six  treatment-combinations 


2.2  (Generalized  Inverse  (Gl) 

The  generalized  inverse  has  received  much  attention  recently.  it  is  par¬ 

ticularly  useful  in  solving  singular  linear  systems  of  equations.  The  GI  of  an  arbitrary  matrix 
C  of  dimensions  m  x  n  is  denoted  by  and  is  the  matrix  which  satisfies  the  relations 


C*  -  C*  C  C’ 
C  -  C  C*  C 

(c:*c)'  -  c*  c 

(CC’)'  =  cc* 


^Roo,  C.  R.  (1962)  A  Note  on  o  Generalised  Inverse  of  o  Matrix  With  Applications  to  Problems  in  Mathematical 
Statistics.  J.  Roy  Stot.  Soc  (B),  24,  152-1SS. 

'Zelen,  M.  and  Goldman,  A.  J.  (1964);  Weak  Generalized  Inverses  and  Minimum  Voriuice  Linear  Unbiased  Esti¬ 
mation.  J.  Res.  Not'l.  Bur.  Stds.  68B,  151-172. 

^Ben-lsrael,  A.  ond  Wersay,  S.  J.  (1?6J),  An  Elimination  Method  for  Computing  the  Generalized  Inverse  of  an  Ar- 
bitrory  Complex  Motrix,  Jour.  Assoc.  Comp.  Mach.  1^  532-537. 

^Greville,  T.  N.  E.  (1961)  The  Pseudoinverse  of  o  Rectangular  or  Singular  Matrix  and  its  Application  to  the  Solu¬ 
tion  of  Systems  of  Linear  Equotions.  SIAM  Review, _1,  38-43. 

j^Penrose,  R.  (1955)  A  Generalized  Inverse  for  Matrices.  Proc.  Comb.  Phil.  Soc.  51.  406-413. 

■^Seorle,  S.  R.  (1965)  Matrix  Algebra  for  the  Biologicol  Sciences,  John  Wiley  ond  Sons,  New  York. 


10 


The  reduced  normal  equations  used  here  v/ill  always  be  singular,  and,  hence,  the  GI  will 
be  used  to  obtain  their  solution.  In  many  cases,  the  coefficient  matrix  C  of  the  normal  equa¬ 
tions  is  idempotent,  (C^  =  C),  or  quasi-idempotent,  (C^  =  \C,  \  a  scalar).  In  these  cases,  it  is 
readily  verified  that  the  G[  of  C  is  given  by  C*  -  For  the  relatively  infrequent  cases 

where  C  is  not  quasi-idempotent,  the  Q  is  computed  using  the  method  of  Een-Israel. 


3.  ANALYSIS  OF  BLOCK  DESIGNS 
3.1  Notation  and  Model 

Consider  a  design  involving  a  fraction  or  all  of  v  treatments  applied  to  b  blocks.  Let 
block  J  contain  kj  treatments,  j  =  1,  2,  .  .  .,  t^and  let  freatment  i  be  replicated  r^  ,  i  =  1,  2, 
...  V,  times  throughout  all  blocks.  For  the  classical  balanced  or  partially  balanced  incom¬ 
plete  designs  k  j  and  r  j  are  constants  over  all  i  and  j.  There  is  no  such  restriction  herein. 
Furthermore,  to  intro^ce  unequal  number  of  treatments  per  plot  per  block,  let  ■  denote 
the  number  of  times  treatment  i  appears  in  block  j.  Hence  we  will  have 


and 

r. 

I 

Let  y^  ,1,  denote  the  yield  of  the  k<^  replication  of  the  i^  treatment  in  the  J**'  block.  We  will 
assume  the  usual  fixed  effects  model, 


Vijk  =  -  *  tj  .  bj  . 

i  -  1. 

. 

,  V 

j  =  1. 

2.  •  .  • 

.  h 

(1) 

tl 

2,  •  ■  . 

*  ij 

where  t  ^  is  the  fixed  effect  of  the  i  treatment,  b  ^  the  fixed  effect  of  the  j  block,  -  the 
general  effect,  and  the  are  independent  random  variables.  (The  mixed  effects  model, 
using  the  unified  methods  herein,  has  been  considered,*^  although  it  has  not  been  incorporated 
in  this  paper.)  For  the  sake  of  tests  of  significance  it  will  ba  assumed  that  each  is  dis¬ 
tributed  nornially,  N(0,  ).  We  further  assume  that  effects  tj  and  b^  are  subject  to  the 

restraints 

V  b 

i-i  i-i 


*^Kurk|ion,  B.,  (1960)  General  Theory  for  Aeymmefricol,  Confounded,  Foctoriol  Experiments,  TR*829  Horry  Diomond 
Lobe.,  Woshington,  D.C. 


Let  N  =  (Qj  j  i  be  the  (v  x  b)  incidence  matrix  of  the  design  where  nj  j  =  0  or  1  depending 
on  whe^ier  the  i*"  treatment  is  absent  or  present  in  the  j  block.  Let  =  ("ti  j )  =  (Dj  j  j  ) 
denote  the  generalized  incidence  matrix.  Then  the  least  squares  estimates  of  the  treatment 
effects  can  be  obtained  in  the  usual  way,  by  minimizing 


V  b  > ) 


"ij  (Vijk  ‘i  -  ‘’jT 


i*l  j=l  k=l 


with  respect  to  t. ,  b .  and  /x.  Eliminating  b^  and  m  from  the  resulting  normal  equations,  one 
obtains  the  reduced  normal  equations,  C  t  =  Q,  where 


Q  =  T-LK‘‘b. 


C=  R-LK‘*L' 


T'  =  (Ti  Tj  .  .  •  Ty). 


j=l  k!>l 


B'  =  (Bi  83  .  .  .  Bb). 


V  * ) 


1*1  k*l 


p 

R  =  diag  (rj  rj  •  •  •  r^).  fj  - 

V 

K  =  diag  (kj  kj  •  •  •  k^),  •'j  = 


The  elements  of  C  can  be  expressed  as 


O 

r-  -  •€?.  'k.. 

*  ‘J  J 


i  =  1,  2. 


D 

^,/kj.  i.  s  =  1.  2.  •  •  •  V.  i  /  s 


As  will  be  shown  in  section  3.5  the  solution  to  the  reduced  normal  equations,  Ct  =  Q,  is  given 
by 


t  =  C"  Q 
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where  is  the  generalized  inverse  of  C.  It  can  easily  be  shown,  using  the  expressions  (3), 
that  the  rows  and  columns  of  C  sum  to  zero.  Hence  the  rank  of  C  is  always  less  than  v.  As 
will  be  shown  in  section  3.3.,  the  concept  of  connectedness  of  the  design  will  be  useful  in  de¬ 
termining  the  rank  of  C,  and,  equivalently,  the  degrees  of  freedom  associated  with  the  treat¬ 
ment  sums  of  squares. 

Furthermore  it  is  readily  verified  that  Var  [Q]  =  C  so  that  the  variance-covariance 
matrix  for  the  treatment  effects  is  given  by 

Var  (t)  =  C*  Var  [(J)  C*  =  C* 


The  sums  of  squares  due  to  treatments  can  be  expressed  as 

SS  (t)  =  t'  0  =  t'  C  t  =  (t  )  (V  (t)]*  Ct)  a2. 

Letting  y  =  (n;  j  yj  )  be  the  vector  of  observations,  w  the  total  number  of  observations, 

i.e., 


V  b 


t,,, 


and  G  the  sum  of  all  the  observations,  i.e.. 


V  b  <i 


1=1  JM 

the  analysis  of  variance  table  can  be  expressed^*  ^  as 


Source  of  Variation 

Sums  of  Squares 

Degrees  of  Freedom 

Treatments  (adjusted  for  blocks) 

t'Q 

Rank  C 

Blocks  (unadjusted) 

gVw 

b-  1 

Error 

Y'Y-t'Q-  B'K‘*B 

w  -  Rank  C  -  b 

Total 

Y'Y  -  G  Vw 

w-  1 

3.2  Connected  Designs  and  the  Rank  of  C 

A  coimected  design  can  be  defined  as  follows.  Two  blocks,  b j  and  bj  ,  are  said  to  be 
connected  if  they  contain  some  treatment  in  common.  A  third  block,  b.  ,  Is  said  to  be 


^Tocher,  K.  D.  (1952)  The  Design  ond  Analysis  of  Block  Experiments,  J.  Roy.  Slot.  Soc.,  Ser_B,  14,  45-91. 
'Kempthorne,  0.  (1952)  Design  ond  Anolysis  of  Experiments,  John  Wiley  ond  Sons,  New  York. 


connected  to  both  of  these  blocks,  if  it  has  at  least  one  treatment  in  common  with  either  of  the 
blocks  bjj  or  b  j  2 .  All  blocks  connected  in  such  a  manner  are  said  to  form  a  set  of  connected 
blocks.  If  all  blocks  in  a  given  design,  involving  all  v  treatments,  are  connected  through  such 
a  chpiu  of  common  treatments,  the  design  is  said  to  be  connected  and  to  consist  of  one  set  of 
connected  blocks,  S  =  (bj,  b2,  .  .  •  b^)  where  elements  of  S  denote  the  block  labels. 

For  connected  designs  with  no  missing  treatments  it  is  well  known^  that  the  rank  of  C  is 
V  -  1.  That  is,  for  connected  designs  it  is  readily  shown  that  one  can  construct  (v  -  1)  linearly 
independent  relationships  between  the  treatment  parameters.  Hence  the  rank  of  C  is  v  -  1. 
Consequent!}',  the  one  constraint 


V 


inherent  in  the  model,  is  all  that  is  required  to  get  a  unique  solution  to  the  reduced  normal 
equations  Ct  =  Q. 

Using  the  calculus  for  factorial  arrangements,  the  analysis  of  balanced  (hence  connected) 
incomplete  block  designs  is  particularly  elegant  and  simple*-^.  The  main  purpose  of  this  paper 
is  to  extend  the  basic  results  of  Kurkjian  and  Zelen  to  the  case  of  disconnected  designs. 


3.3  Disconnected  Designs,  Missing  Treatments,  and  the  Rank  of  C 

When  all  the  blocks  are  not  connected  via  a  chain  of  common  treatments,  the  design  is 
said  to  be  discozmecied.  In  this  case  there  will  be  more  than  one  set  of  connected  blocks.  For 
example,  the  design  with  incidence  matrix 


1  0  1 

N  =  0  10 

0  0  1 


is  disconnected  since  block  2  has  no  treatment  in  common  with  blocks  1  and  3.  Since  blocks 
1  and  3  are  connected  via  treatment  1,  the  design  N  is  said  to  decompose  into  two  sets  of  con¬ 
nected  blocks:  Sj  =  (bj ,  b3)  and  Sj  =  (bj). 

In  general,  tne  determination  of  the  number  of  sets,  Zj ,  of  connected  blocks  is  a  trivial 
task,  obtained  by  inspection  of  the  incidence  matrix  of  the  design. 

As  the  following  theorem  shows,  the  number  of  distinct  sets  of  connected  blocks,  z  ,  and 
the  number  of  missing  treatments,  Zj,  in  the  design  will  determine  the  rank  of  the  coefficient 

^Kurkjian,  B.  ond  Zelen,  M.  (1962)  A  Gilcuius  (or  Factorial  Arrangements  Ann.  Math.  Stat.^,  609-619. 

*Kurkjicn,  B.  and  Zelen,  M.  (1963)  Applications  of  the  Colculus  (or  Factorial  Arrangements  I.  Block  and  Direct 
Product  Designs,  Biometrika  50,  63-73. 

^Tocher,  K.  D.  (1952)  The  Design  and  Analysis  of  Block  Experiments,  J.  Roy.  Stat.  Soc.,  Ser  B,  14,  45>91. 


matrix  C  of  the  reduced  normal  equations  and,  hence,  the  total  number  of  constraints  required 
to  achieve  a  unique  solution  to  these  equations.  Moreover,  rank  C  also  yields  the  degrees  of 
freedom  associated  with  the  treatment  sums  of  squares  in  the  analysis  of  variance  table. 

Theorem  1.  For  any  block  design,  the  rank  of  the  v  x  v  coefficient  matrix  C  of  the  re¬ 
duced  normal  equations  c£  =  Q,  is  v  -  ~  ^<2  *  ^  number  of  treatments  in 

the  experiment,  Zj  is  the  number  of  sots  of  connected  blocks,  and  Zj  is  the  number  of  treat¬ 
ments  for  which  no  observations  were  taken  during  the  experiment. 

Proof:  Without  loss  of  generality,  one  may  assume  that  the  first  qj  treatments  are  as¬ 
sociated  with  the  first  set  of  p  j  connected  blocks,  the  second  qj  treatments  with  the  second 
set  of  P2  connected  blocks,  and  the  penultimate  qzj  treatments  with  the  Zj^  set  of  p  z, 
connected  blocks.  Moreover,  let  the  last  treatments  be  those  missing  in  the  experiment. 
This  assignment  could  be  achieved  through  appropriate  relabeling  of  treatments  and  blocks. 
With  such  a  rearrangement,  it  follows  directly  from  the  definition  of  connected  blocks,  that 
the  generalized  incidence  matrix  L  can  be  written  in  partitioned  form  as: 


fki  (Qi  X  Pi)  0  (Qi  X  P2)  •  •  •  0  (Oj  X 
0  (q2><Pi)  ■  ^(P2'‘Pzj) 


0  (q*,  Pp  0  (qzjXPj)  •  •  •  X  p^^) 

0  (Z2  X  Pj)  0  (Z2  X  Pj)  •  •  •  0  (Z,  X  p^^) 

where  the  dimensions  of  each  of  the  eleme . '  of  L  is  given  in  the  parenthesis.  Clearly  then, 

i'J 


and  the  (v  x  v)  coefficient  matrix,  C  =  R  -  LK" '  L' ,  can  be  written  in  partitioned  form  as  the 
diagonal  matrix: 


C  =  ding  [Cj  (qj  x  qj)  Cj  (qj  x  qj)  •  •  •  C,.  (q^^  x  q^^)  0  (Zj  x  Zj)) 


In  accordance  with  section  3.2,  the  rank  of  each  C|^,  k  =  1,  2,  .  .  .,  Zj,  is  (q^  -  1),  since  each 
partition  is  associated  with  a  set  of  connected  blocks.  Hence,  it  follows  that 


Rank  C 


-i: 

k-l 


(qu-l)  =  v-Z2-5:i 


which  completes  the  proof. 
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( 


Since  v,  z. ,  and  are  obtained  almost  instantly  inspection  of  the  incidence  matrix  of 
any  arbitrary  block  design,  the  number  of  estimable  treatment  parameters  and,  hence,  the  de¬ 
grees  of  freedom  associated  with  the  treatment  sums  of  squares  is  reduced  to  the  trivial  cal¬ 
culation  V  -  Zi  -  Z2. 


3.4  Choice  of  Constraint  Matrix 

To  achieve  a.  unique  solution  to  the  normal  equations,  Ct  =  Q,  where  rank  C  =  v  -  Zj  -  Zj , 
we  will  need  (Zj  +  Zj)  additional  independent  relationships  between  the  treatment  effects.  In 
this  paper  we  obtain  these  relationships  by  adopting  the  convention  that  the  sum  of  the  treat¬ 
ment  effects  associated  with  each  set  of  connected  blocks  is  zero,  i.e.,  each  treatment  param¬ 
eter  is  expressed  about  the  mean  of  the  effects  associated  with  that  particular  set  of  connected 
blocks.  Moreover,  for  each  missing  treatment  in  the  design,  the  corresponding  treatment  ef¬ 
fect  will  be  assumed  expressed  about  its  own  true  value,  hence,  assigned  tho  value  zero. 

This  convention  is  quite  commonly  used  by  other  investigators  although  it  may  not  be  ex¬ 
plicitly  stated  in  their  published  works. 

With  the  treatment  labeling  as  given  in  theorem  1,  this  convention  can  be  expressed  mathe¬ 
matically  as  the  solution  to  U' t  =  0  where  U'  is  the  l(Zj  +  Zj )  x  v]  matrix 

It  follows  Immediately  from  the  proof  of  theorem  1  and  from  the  fact  that  the  rows  and  columns 
of  C  sum  to  zero,  that  U'  C  =  0.  Moreover,  it  is  obvious  that 


dot  (U'  U)  =]~[  Oi 

I'l 

and,  hence,  is  not  zero.  In  general,  U '  can  be  written  on  inspection  of  L. 


3.5  Estinuition  for  Block  Designs 

For  the  constraint  matrix  U’ ,  with  properties  U  'C  =  0  and  det  (’j'U)  ¥  0,  the  solutions 
to  the  augmented  normal  equations 


can  be  shown  to  be  ^ 


(6) 


tion.  J.  Ret.  Not'l.  Bur.  Stdt.  68B,  151-172. 


i  =C*  Q.  (7) 

where  C*  is  the  GI  of  C.  Fortunately,  for  many  designs,  C  has  the  property  that  =\  C 

where  ^  is  a  scalar  constant.  In  suoh  cases  the  GI  of  C  is  readily  verified  to  be  =  C/\^. 

The  digital  program  developed  for  this  analysis  checks  the  coefficient  matrix  C  for  this 
idempotency  property  at  the  outset.  When  C  is  not  idempotent,  then  the  GI  is  computed  using 
the  method  of  Ben-Israel  and  Wersay. 

The  results  of  section  3  are  sufficient  for  the  analysis  of  experiments  involving  simple 
treatments  applied  to  any  arbitrary  block  design,  balanced,  connected,  or  not.  The  next  sec¬ 
tion  extends  the  results  to  the  case  of  experiments  involving  factorial  treatment-combinations 
applied  to  general  block  designs. 


4.  ANALYSIS  OF  FACTORIAL  EXPERIMENTS  IN  BLOCK  DESIGNS 
4.1  Notation  and  Model 

Consider  now  a  factorial  experiment  involving  n  experimental  factors,  A^,  where  factor 
A,  appears  at  m^  levels,  s  =  1,  2,  .  .  ..  n.  A  particular  selection  of  levels  for  each  factor, 
i  =  (ii  i  2  ...  in),  will  be  termed  the  i^"  treatment-combination,  i  =  1,  2,  .  . .,  v,  where 


n 


s«l 


Let  =  (1,  2,  . . .,  m,)  be  a  vector  whose  elements  denote  the  levels  at  which  factor  A^  ap¬ 
pears.  Then  the  SDP,  0  e  0^  @0^,  a  column  vector  of  dimension  v,  will  be  used  to 

label  and  order  the  v  dinerent  treatment-combinations.  For  example  for  two  factors  each  at 
two  levels,  we  have  the  vector  of  four  treatment-combinations  given  by 


Hence  treatment  1  is  composed  of  the  first  levels  of  each  of  the  two  factors  Aj  and  Aj,  etc. 
Treatment  i  is  the  element  in  the  i^^  row  of  5j©  ^2  , 1  =  1,  2,  3,  4. 

These  treatments  then  are  i^iplied  to  any  block  design  to  estimate  the  effects  of  the  ex¬ 
perimental  factors  acting  alone  or  in  interaction  with  other  factors.  For  this  purpose  let 
a'  =  (a,  (i,))  denote  a  row  vector  of  length  m  ,  whose  general  element  a,(i,)  represents  the 
effect  of  the  experimental  factor  A^  at  level  i,.  Moreover,  let  a^,(i^,  1,)  denote  the  effect  of 
the  two  factor  interaction  associated  with  factors  A^  and  A^  at  levels  i^  and  i^,  respectively. 


^®Ben-liroel,  A.  and  Wersay,  S.  J.  (1963),  An  Elimination  Method  for  Computing  the  Generoliied  Inverse  of  on  Arbi¬ 
trary  Complex  Matrix,  Jour.  Assoc.  Comp.  Mach.  JO,  532-537. 


17 


Then  the  vector 


[Bf  ®  aj  '  =  (11).  (12).  •  •  -a,,  (Im),  (21),  .  .  .  a„  (2m), 


a„  (m,  1),  ...  a^^  (m^  m,)] 


displays  the  ni^m,  two-factor  interaction  parameters  associated  with  the  experimental 
factors  A,  and  Likewise,  fa.  ®  a.  ®.  . .  ®  a.  1  is  a  row  vector  displaying  the 

*  L  ‘i  2  *pj 

p 


interaction  parameters  associated  with  the  p  &ctor  interaction  A.  A.  .  .  .  A^  .  Clearly, 
there  will  be  2"  -  1  vectors  containing  '  ^ 


JJ  (1  +  mj)  -  1 

i*l 

such  parameters  in  all.  It  is  quite  common  in  practice  to  express  the  treatment  effects, 
ti ,  in  terms  of  these  main  effect  and  interaction  parameters  sm 


n 

+  Z]  Z]  (‘r*  »,)  + 

s*l  s  <  r^n 


+  °12..  .n  (»!•  ‘2-  •  •  •  ‘n)- 


(8) 


i  =  1,  2 . V 


These  relations  can  be  written’  in  matrix  form  as 


{a,  ((a^))  *  82  ((Oj))  *  ...»  Bn  ((«„))> 


(9; 


1 

2 

15 


Kurkjion,  B.  and  Zelen,  M.  (1962)  A  Calculus  far  Foctarial  Arrangements  Ann.  Math.  Stat.  609.619. 

Kurkjian,  B.  And  Zelen,  M.  (1963)  Applications  of  the  Calculus  for  Factorial  Arrongementp  I.  Block  and  Direct 
Product  Designs,  Biometriko^,  63.73. 

Zelen,  M.  (1958)  The  Use  of  Group  Divisible  Designs  for  Confounded  Asymmetricol  Foetoriol  Arrongements,  Ann 
Moth  Stot.  29,  22.40. 
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where 


aj  ((tti))  = 


a,  i  f  a;  =  1 


Ij  if  aj  =  0 


ai((a  ))*a.  ((a.))  = 


aj  ®  Bj  if  ttj  =  a.  =  1 
a.  X  Ij  i  f  aj  =  1,  ttj  =  0 

Ij  X  Bj  i  f  Oj  =  0.  Oj  =  1 

li  h  “i  =  aj  =  0. 


In  the  starred  operations  in  eq.  (9)  the  products  Sj  x  Sj  and  a-  &  Ij  are  not  defined  and  arc 
termed  inadmissible  products. 

When  admissible  direct  and  symbolic  direct  products  both  appear  in  eq.  (9),  we  adopt  the 
convention  that  DP's  are  formed  first  and  followed  by  the  SDP’s.  For  example  if  n  =  3, 
mj  =  mj  =  m3  =2,  “i  -  “3  =  1,  “2  “ 


ai  ((oj))  *  Bj  ((aj))  *  83  ((a3))  =  (aj  x  Ij)  ®  83 


^aj  (1) 
(2) 


W] 

(2)j 


(1) 
a,  (1) 
a,  (2) 

aj  (2) 


ai3(H)‘ 
®13  (12) 
®13  (11) 
®13(12) 
®13(21) 
®13  (22) 
®13(21) 
f,3  (22) 


It  is  easy  to  verify-  that  this  operation  is  associative.  These  interaction  parameters  are  no', 
linearly  independent  and  are  taken  to  satisfy  the  linear  relationship  that,  for  any  set  of  mrm 
effect  or  interaction  terms,  the  sum  over  the  levels  of  any  single  factor  is  zero.  In  matrix 
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aniiiiBiiiieiiiir  ■  1  -lirHi-imi 


form  these  constraints  can  be  written  ‘ 


i;  =  0  s  =  1.  2 . n 


[a,  ®  a^]  = 


(10) 


It  is  easy  to  show  that  for  connected  designs  with  no  missing  treatments  (z  j  =  1,  Z2  =  0)  there 
will  result 


+  2]Z]  (m^  _  1)  (nij  -  1)  +  . . .  +  IT  (ni;  -  1)  =  V  -  1 

s"l  r  <  s  i»l 

linearly  independent  interaction  parameters.  Also,  it  is  well  known  (section  4.2)  that  these 
(v-1)  linearly  independent  parameters  are  expressable  as  linear  combinations  of  the  elements 
of  t  which  are  obtained  from  the  reduced  normal  equations  Ct  =  Q.  For  the  case  where 
z  j  '1'  Z2  >1,  the  further  constraints  U't  =  0  on  the  t  parameters  will  also  have  to  be  imposed 
on  the  (v-1)  interaction  parameters. 


^Kurkjian,  B.  and  Z«len,  M.  (1962) 


A  Calculus  for  Foctorial  Arrangcmonts  Ann.  Math.  Stat.  33,  609-619. 
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4.2  Estlmatlcn  for  the  Factorial  Case  for  Connected  Deslgaa 
and  No  Missing  Treatments 

1  2 

This  case  has  been  treated  fully  '  using  the  basic  method  of  this  paper.  The  main  re¬ 
sults  are  restated  here  for  completeness  and  to  set  the  stage  for  some  results  in  section  4.3 
below.  Let  X  =  (Xj  X2  •  •  •  x„)  be  a  vector  representing  an  interaction  term  where  the  ele¬ 
ment  X.  is  defined  as 


Xj  =  1  if  factor  Aj  is  present  in  the  interaction  X 
Xj  =  0  if  factor  Aj  is  absent  in  the  interaction, 


i  =  1,  2,  , , n. 


Clearly,  there  will  be  2"  -  1  such  vectors.  The  vector  X  =  (0.  .  .  010  ...  0)  with  a  one  in  the 
r  position  and  all  other  elements  zero  denotes  the  main  effect  of  factor  A„  x=  (0 . . .  010 . . .  CIO 
...  0)  with  elements  in  the  r^^  and  s^^  positions  equal  to  one  and  all  others  zero,  denotes  the 
two-factor  interaction  A^  A, ,  etc.,  X  =  (11  ...  1)  wltli  all  elements  unity  denoting  the  n-factor 
interaction  A^A^  .  .  .  A^.  For  the  purposes  of  this  paper,  the  vectors  X- ,  i  =  1,  2,  .  .  .,  2"  -  1 
will  be  ordered  as  follows:  All  vectors  denoting  main  effect  terms  first,  those  denoting  two- 
factor  interactions  second,  etc.,  with  the  n-factor  interaction  term  last.  Within  each  of  these 
groups,  (i.e.,  interaction  terms)  the  vectors  are  ordered  lexicographically.  For  example,  if 
n  -•  3,  we  will  have  2^  -  1  =  7  vectors  in  the  following  order;  (100),  (010),  (001),  (110),  (101), 
(011),  (111). 

Now  lot 


X,  X., 

a  (X)  =  Bj*  ®  @  .  ®  a„".  >  Xj  =  p 


denote  the  effect  of  a  particular  p-factor  interaction  term  where  Sj  ‘  =  aj  if  x.  =  1  and  where 

aj  is  suppressed  on  the  right-hand-side  of  eq.  (12)  if  Xj  =0. 

As  shown  by  Kurkjian  and  Zelen,‘  the  minimum  variance  unbiased  estimator  for  a(X)  is 
given  by 


where 


a  (X)  -  M  (X)  t  /V  =  M  (X)  C*  Q/v 
M  (X)  =  M*'  X  Mj**  X  .  .  .  X  M*" 

Mi‘  =  M;  =  mj  Ij  -  Jj  if  Xj  =  1 


i  f  Xj  =  0 


^Kurkjian,  B.  and  Zelen,  M.  (1962)  A  Calc-jius  for  Foctoriol  Arrongotnentt  Ann.  Moth.  Sfot.  33,  609-619. 
^Kurkjian,  B.  ond  Zel«n,  M.  (1963)  Applications  of  the  Calculus  for  Foctoriol  Arrangements  I.  Block  and  Direct 
Product  Designs,  Biometriko  SO,  63-73. 
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Moreover,  it  follows  directly  that 


Var  [a(X)]  =  M  <X)  C*  M  (X)'  a'^/v'  -  where 


(14) 


5;(X)  -  M  (X)  C  M  <X)'/v2 


Likewise,  for  different  interaction  terms  Xj  and  Xj , 


Cov  [a  (Xj).  a  (Xj)l  =  M  (X;)  C*  M  (Xp'  0^2/ v^.  (15) 


Using  a  result  given  by  Rao^  and  Zelen  and  Goldman/  the  sums  of  squares  associated 
with  the  interaction  term  X  is  given  by 


SS  (a  (X)l  =  a'  (X,  (Var  a  (X))*  a  (X)  =  a'  (X)  I  (X)*  a  (X).  (16) 


Under  the  null  hypothesis  of  no  interaction  effect,  SS(a(X))  is  distributed  as  a  chi-square  vari¬ 
ate  with  degrees  of  freedom  equal  to  the  rank  of  Var  [  a(X)] . 

If  the  design  is  orthogonal  (i<e.,  Cov  [  a(X- ),  a(Xj )]  =  0  for  all  i,  j,  i  ^  j),  then  it  is  known 

that 


2"-l 

SS(t)  =  3S  [a  (Xj)]. 


(17) 


If  the  design  is  not  orthogonal  then  the  SS(a(Xi ))  are  not  additive.  However,  as  shown  by 
ChraybiUf  each  quadratic  form,  SS(a{Xi )),  is  statistically  independent  of  the  error  sum  of 
squares.  Hence,  tests  of  slgniHcance  based  on  the  F  distribution  are  still  valid. 

The  analysis  of  variance  table  is  given  by 


W.  C.  R.  (1962)  A  Nofo  on  0  Gwieralized  Invvrs*  of  o  Motrix  WiHt  Appiicotiors  to  Problems  in  Motbtmatieol 
Sfofitfks.  J.  Roy  Stot.  Soc  (B),  2^  152-158. 

'Zelen,  M.  and  Goldman,  A.  J.  (1964)  Weok  Generalized  liiv^xses  ond  Minimum  Voricnce  Linear  Unbiased  Estimo' 
tion.  J.  Res.  Nat’l.  Bur.  Sfds.^,  151-172. 

®Graybill,  F.  A.  (1961)  An  Introduction  to  t.ineor  Stotisticol  Models,  Volume  I,  .McGray-Hill,  New  Yodt. 
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gjSUttn 


f 


t 

I 


i 


Source  of  Variation 

Sums  of  Squares 

Degrees  of  Freedom 

Xi 

SS(a(X,)) 

RankipCj) 

X2 

• 

SS(a(X2)) 

RankI(X2) 

« 

X  „ 

2"-l 

• 

• 

SS(a(X  )) 

2"-l 

2;(X2„_j  ) 

Blocks  (unadjusted) 

GVw 

b-  1 

Error 

y  Y-tQ  -  B'K ‘b 

w  -  Rank  C  -  b 

Total 

Y'Y-  gVw 

w  -  1 

4.3  Estimation  for  the  Factorial  Case  for  Diaconaected  Designs  with 
KQsslng  Treatments  (z  j  +  >  1) 


i\s  Indlf'ated  In  section  3.3,  for  the  general  case  when  the  design  Is  not  connected  or  only 
a  fraction  of  the  treatment-combinations  are  tested,  the  rank  of  the  coefficient  matrix,  C,  of 
the  reduced  normal  equations  Is  v-Zj-Zj.  In  this  case  one  must  select  a  particular  set  of 
v-Zj-z^  parameUxs  for  which  a  unique  solution  to  the  normal  equations  will  exist.  In  this 
paper  the  selection  is  made  as  follows.  First  eliminate  those  parameters  that  are  dependant 
as  a  consequence  of  the  basic  constraints  (eq.  10).  This  Is  done  by  eliminating  all  but  the 
(mj  -  1)  lowest  level  parameters  of  the  main  effect  vectors,  a(Xj),  associated  with  the  ex¬ 
perimental  factors  Ai ,  1  -  1,  2,  . .  .,  n;  all  but  the  <mj  -  1)  (m  j  -  1)  lowest  level  parameters 
of  the  two-factor  Interaction  vectors  associated  with  experimental  factors  Aj  Aj ,  .  .  .;  and  all 
but  the 


TT  (mj  - 1) 

1-1 

lor/est  level  parameters  belonging  to  the  n-factor  interacticn  A^  A^  ...  A;,.  Hence,  all  but 
(V  -  1)  parameters  are  eliminated.  Second,  (Zj  -*■  Z2  -  1)  of  these  v  -  1  parameters  must  be 
eliminated  because  they  can  be  expressed  as  linear  functions  of  the  remaining  (v  -  zj  -  Z2) 
parameters  through  the  relationships  resulting  from  the  constraint  equation  U*  t  =  0  of  section 
3.4.  One  chooses  the  (z^  ■<-  Z2  -  1)  parameters  to  be  those  which  are  unestimable  (as  defined 
in  section  4.3  below)  or  those  associated  with  higher  order  interaction  terms. 

To  clarify  this  parameter  selection  scheme,  and  to  set  the  stage  for  an  efficient  compu¬ 
tational  algorithm  for  the  estimation  problem,  It  is  convenient  to  introduce  the  following 
quantities. 

Let  a  denote  the  universal  vector,  of  dimension 

n 

I  I  (1  +  nii)  ■  I. 

i-1 
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M'  =  [M'  (X,)  M'CXj)  .  .  .  M'  (X2„_j)]- 

Not  let  S  denote  the  vector  of  v  -  1  elements  remaining  after  elimination  of  the  parameters 
that  are  dependent  because  of  the  basic  constraints  of  eq.  (10),  and  let  M  be  the  matrix  con¬ 
sisting  of  the  corresponding  rows  of  Thus,  we  have  for  reference 


a'=[a(Xi)  a'fXj)  .  .  .  a'  (X^„_j)]. 
and 

M' =  (M' (Xi)  M'(X2)  .  .  .  M' (X^„_j)). 

Let  a'  =  [a'  (X^)  a'  (Xj^ )  .  .  .  a'  (Xj^ )]  denote  the  vector  containing  a  total  of  v  -  Zj  -  Zj 
parameters  that  remain  after  the  fur^r  elimination  of  parameters  m  a,  through  application 
of  the  constraint  equation 

n 

U' t  =  U'2^  a“‘  *  a“^  *  .  .  .  *  a""  =  0.  (19) 

*•1  laj-J 

Removing  the  cori.  osponding  rows  of  M  there  results 

W] 

The  vector  a  now  contains  the  v  -  Zj  -  Zj  linearly  independent  parameters  which  permit  un¬ 
biased  minimum  variance  estimation  and,  hence,  are  termed  estimable  parameters  in  the 
standard  sense.^  In  this  paper  elements  of  a  will  be  termed  independent  parameters.  Elements 


®Groybill,  F.  A.  (1961)  An  Introduction  te  Lineor  StotisticcI  ModaU.  Volume  I,  McGroy-Hill,  New  York. 
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of  a  that  do  not  appear  in  a  will  be  termed  dependent  parameters.  The  interaction  Xj  , 
j  =  1,  2,  .  .  B,  is  represented  in  a  if  at  least  one  element  of  a(Xi .  )  is  a  member  of  a.  ’  Suet* 
interactions  will  be  termed  estimable  or  ttnestimable  in  the  sense 'described  in  the  next  sec¬ 
tion.  The  original  singulai  system  of  normal  equations  has  now  been  reduced  to  a  non-singu¬ 
lar  system  of  rankC=v-Zj  -  Zj  and,  hence,  yields  the  following  stanc!ard  quantities  as 
solutions. 


a  j  =  M  ^Xi  j  t/v  =  M^Xj  J  C*  O^v 

Vsr  («(Xi  M  (Xi  J  C  M'  (Xj  J  a^/v^  ^  f  JXj  ] 

cov(S{x,jl(x,  J=5(x,jcr(x,^j»VAi..j, 

j  =  1.  2 . s 


(20) 


The  analysis  of  variance  table  is  given  by: 


4.4  Unestimable,  Aliased,  and  Confounded  InteractionB 

The  theory  of  confounding  and  aliasing  is  easy  to  apply  for  the  case  of  2"  designs.  How¬ 
ever  for  general  designs  the  determination  of  such  effects  is  quite  difficult.  The  literature  in 
many  cases  identifies  the  aliased  and  confounded  interactions  without  giving  the  mathematical 
foundation  for  the  determination.  In  this  paper  the  definition  ot  such  effects  Is  based  on  the 
linearly  indepei^nt,  bence  estimable,  parameters  in  the  solution  to  the  normal  equations,  i.e. 
the  elements  of  a  in  section  4.3 

Ckmsider  an  effect  vector  a(X^ )  associated  with  the  interaction  ^  =  1,  2,  . . .,  2^  -  1. 
The  following  definitions  will  be  used  to  characterize  its  estimability. 
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Definition  1.  Estimable  and  Uneatimable  Interactions 

If  all  elements  of  &(X. )  belonging  to  a  are  also  in  ^  the  interaction  is  termed  estim¬ 
able.  If  some  (or  all)  of  me  elements  ofa(X^)  do  not  belong  to  a,  then  the  mteraction  is 
said  to  be  partially  (or  totally)  imestimable.  Some  unestimable  interactions  can  further  be 
classified  as  aliased  or  confounded. 

Definition  2.  Aliased  Interactions 

An  interaction  X^  will  be  termed  an  alias  of  a  lower  order,  at  least  partially  estimable 
interaction  X^^,  if  at  least  one  dependent  effect  parameter  associated  with  X^  is  linearly  de¬ 
pendent  on  at  least  one  independent  effect  parameter  associated  with  X„  .  It  should  be  noted 
that  this  definition  allows  partially  unestimable  interactions  to  be  aliased  with  more  than  one 
lower  order  interaction. 

Definition  3.  Confounded  Interactions 

If  for  the  interaction  X^: 

(i)  the  effect  vector  a(X^)  contains  only  dependent  parameters,  i.e.,  has  no  elements  in  a,  and 

(ii)  each  of  thes|. dependent  parameters  is  not  linearly  related  to  any  of  the  independent 
elements  in  a,  and 

(Ui)  b^  1, 

then  X^  is  said  to  be  completely  confounded  with  blocks.  If  b  =  1,  then  X^  is  said  to  be  com¬ 
pletely  unestimable. 

Definition  4.  Partially  Confounded  (Unestimable)  Interactions 

If  the  effect  vector  a(X^)  associated  with  the  interaction  X^  contains  dependent  elements 
that  are  linearly  related  only  to  its  own  independent  elements,  then  X„  is  said  to  be  partially 
confounded  with  blocks,  provided  b  >  1.  If  b  =  1,  X^  is  said  to  be  parually  unestimable. 


5.  COMPUTATIONAL  PROCEDURE 


The  computational  procedure  can  be  summarized  as  follows; 

Step  1.  Given  the  generalized  incidence  matrix  L  and  the  vector  of  observations,  Y  =  (n. .  y.  ), 
compute  C  and  Q  (cf.  section  3.1).  ** 

Step  2.  Compute  the  generalized  inverse  C*  and  obtain  the  solution  to  the  reduced  normal  equa¬ 
tions,  i.e.  t  =  C^Q  (cf.  section  3.5). 

Step  3.  By  inspection  of  L  determine  z,  and  z,  and  compute  rank  C  =  v  -  z.  -  4.  (cf.  section 
3.3). 


Step  4.  Compute  the  analysis  of  variance  table  as  indicated  in  section  3.1. 

For  factorial  experiments,  the  following  additional  computations  are  made.  The  treatment 
combinations  and  the  rows  of  L  must  be  labeled  and  ordered  in  accordance  with  section  4.1. 
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step  5.  Compute  the  main  and  interaction  effect  vectors  &(X. )  =  M(X. )  l/v  and  form  &(X|)  and 
M(Xj ),  i  =  1,  2,  .  .  .,  2"  -  1  (cf.  section  4.2).  If  rank  C  =  v  -  3 ,  set  I(Xj )  =  a(Xj )  and  M(X. )  = 
M(X. ),  and  proceed  to  step  9. 

Step  6.  Construct,  by  inspection  (cf.  section  3.4)  the  constraint  matrix  U' ,  of  dimension 
(Zj  +  Zj)  X  V,  relate  the  interaction  parameters  to  the  treatment-combination  parameters'  (cf. 

CQ*  (d})»  determine  the  constraints  on  the  interaction  parameters  due  to  the  application  of 
U' t  =  0. 

Step  7.  Form  a(Xj )  by  eliminating  from  fi(X£ ),  i  =  1,  2,  .  .  .,  2^^  -  1,  those  interaction  param¬ 
eters  equal  to  zero  or  those  of  highest  order  in  the  constratots  determined  in  step  6.  Similarly, 
form  M(X. )  by  eliminating  the  corresponding  rows  of  each  M(X. ). 

Step  8.  Determine  the  aliased  or  confounded  effects,  if  any,  in  accordance  with  definitions  in 
section  4.4. 

Step  9.  Compute  the  sums  of  squares  and  degrees  of  freedom  for  those  interaction  terms  which 
have  at  least  one  parameter  in  a  as  indicated  in  section  4.3.  The  block,  error,  and  total  sums 
of  squares  and  degrees  of  freedom  are  given  in  the  analysis  of  variance  table  of  section  4.3.  If 
the  design  is  orthogonal. 


Z]  (^S))  =  SS  (t)  =  t'  Q. 

j«i 


6.  EXAMPLES 


In  this  section,  we  give  an  arbitrary  example  to  illustrate  the  notation  and  computational 
procedure  throughout.  Then  we  outline  solutions,  using  the  methods  of  this  paper,  for  two 
examples  published  by  other  investigations.** 


Consider  a  two-factor  experiment  with  factor  A  j  appearing  at  m^  =  3  levels  and  foctor 
Aj  at  mj  =  2  levels.  In  accordance  with  section  4.1,  the  treatment  combinations  are  labeled 


Treatment  Treatment 

Combination  Label 


/ll 

1^ 

12 

2 

21 

3 

22 

4 

31 

5 

32 

6 

16 

17 


Davies,  0.  L.  (1967)  Design  ond  Anolysis  of  Industriol  Experiments,  Hafner  Publishing  Co.,  New  York. 

Zelan,  M.  (1964)  Applications  of  the  Calculus  for  Foctoriol  Arrongements  II:  Unequal  Numbers  In  the  Analysis 
of  Vorionce,  MRC  Tech.  Summary  Report  411,  U.  S.  Army  Moth  Res.  Center,  Univ.  of  Wise. 
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Suppose  the  original  test  design  was,  inadvertently,  not  executed  as  planned,  and  five  of  the 
V  =  6  treatments  were  applied  to  b  =  3  blocks  with  generalized  incidence  matrix, 

2  C  0 

10  0 
^  0  10 

^  0  3  0 

0  0  1 

0  0  0 

What  effects  can  now  be  estimated,  given  this  poorly  executed  design,  and  with  what  efficiency? 
From  this  incidence  matrix,  one  determines  by  inspection  that  R  =  diag  (2  1  1  3  1  0),  K  = 
diag  (3  4  1),  the  number  of  sets  of  connected  blocks  Is  Zj  =3  and  the  number  of  missing 
treatments  is  Zj  =1.  Hence  by  Theorem  1,  the  rank  of  the  coefiicient  matrix  C,  will  be 
v-Zj-Zj  =2.  Computing  C  =  R  -  LK"'l  ',  one  gets  after  reduction 


Oj  Oj  \ 

3/4  Mj  O2 

;  M2  =  2  Ij  -  J2  and  O2  are  square  (21) 

0  0  matrices  of  order  2. 

0  0  0  / 


Since  C  is  a  diagonal  matrix  with  quasi-idempotent  elements  along  the  diagonal,  the  (3  is 
computed  directly  as 


3/8  Mj  Oj  O2 

O2  1''3M2  O2 

0  0  0 

0  0  0 


Suppose  we  are  given  the  vector  of  responses  (cf.  section  3.1) 


Y'  =  (vni  yii2  y2ix  y32i  y42i  ^422  ^423  ^531)- 
Then  the  treatment  and  block  totals  are  given  by 
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(23) 


yiii  +  ^112 

®i  ==  yni  +  yii2  ^211 

^211 

II2  =  y321  +  ^421  +  y422  +  y423 

^321 

^  =  ^531 

>’421  +  y422  *  ^423 

ys3i 

Tfi  =0 

Then  the  vector  of  adjusted  treatment  totals  Q  is  given  hy 


Tj  -  2/3  Bi~ 

1/3  (Vjii  +  yij2  -  2  yaij) 

T2  -  1  '3  Ba 

1/3  (2  yjjj  -  yjj2  -  ym) 

T3  -  1/4  Bj 

1  ^4  (3  >321  -  y42i  -  y422  "  >423) 

T4  -  3/4  Bj 

1  '4  (y^ji  +  y422  +  y423  ■  ^  ^321' 

TS-B3 

0 

_  0  _ 

_  0 

(24) 


The  minimum  variance  unbiased  e°timate  is  then  given  by 


1/4  (yjii  +  yii2  -  2  y22,) 

-  1  '4  (Viii  +  y„2  -  2  y22i) 

-  1/6  (3  y32i  -  y421  -  y422  ■  ^423) 

t  =  c"  Q  =  (25) 

-  1  /6  (3  y32,  -  y42i  -  y422  -  y423) 

0 

_  0 

The  estimation  of  the  main  effect  and  interaction  terms  follows  the  discussion  of  section  4.2. 
The  2^  -  1  =  3  effect  terms  are  ordered  lexicographically  as 

Xj  =  (10):  main  effect  of  factor 

X2  =  (01):  main  effect  of  factor  Aj 

X3  =  (11):  two  factor  interaction  A,  Aj 
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It  is  readily  verified  that 


“12  (11)  =  (Viii  +  yii2  ~  2  yj2i)  ••  1/3  (3  y32i  -  y42i  -  y422  ~  y^aa) 


and 


^12  (21)  =  -  1/2  (yjn  +  yjj2  -  2  y22i)  +  2/3  (3  y32i  -  y42i  -  y422  -  y423)- 


Hence  the  v  -  1  =  5  elements  of  the  a(X)  matrix  of  section  4.3  are  given  by 


a'  (X)=  [ai  (1)  83(2)32(1)  a, 2  (11)  832  (21)). 


(29) 


with  minimum  variance  unbiased  estimates  as  given  above.  The  corresponding  M(X)  matrix  is 
given  by  (cf.  section  4.3) 


2  2  - 1  - 1  - 1  -  r 

’m  (X3) 

- 1  - 1  2  2-1-1 

1-1  1-1  1-1 

m 

M(X2) 

2-2-1  1-2  1 

- 1  1  2-2-1  i_ 

m(X32 

(30) 


Now,  since  rank  C  s  (v  -  Z3  -  =  2)  <  (v  -  1  =  5),  there  exist  Z3  +  Z2  ”  1  =  3  additional  re¬ 

lationships  among  the  elements  in  a(X)  that  sure  determined  from  constraint  equation  U't  =  0. 
In  accordance  with  section  3.4,  the  constraint  matrix  U '  is  given  by 


11 

00 

00 

00 

11 

00 

00 

00 

10 

00 

00 

01 

Using  equation  (9)  and  (10)  we  can  write  the  vector  of  treatment  effects  in  terms  of  the  treat¬ 
ment  combination  parameters  as 


Using  eq.  (20)  and  (36) 


Z  (Xj)  =  Var  a  (Xj) 

1  (Xj)  =  Var  I  (X3) 

Using  eq.  (34),  (20)  and  (37),  the  effect  sums  of  squares  are  now  computed  as 


17 

216 

22 

108 


(37) 


S  S  (a  (Xj))  =  a'  (Xj)  [2  (Xj))’*  a  (Xj)  =  ^  (1) 

S  S  (a  (X3))  =  S'  (X3)  [2  (Xj)]"^  a  (X3)  =  ^  af^  (11) 


(38) 


where  a2(l)  and  ai2(ll)  evaluated  in  eq.  (27)  and  (28),  respectively. 

We  note  in  eq.  (36)  that  the  covariance  between  the  effect  terms  and  A1A2  is  not  zero. 
Therefore,  the  design  is  not  orthogonal,  and  the  sums  of  squares  in  eq.  (38)  cannot  be  expected 
to  sum  to  the  sums  of  squares  for  treatments,  t'Q.  Finally,  from  section  4.3,  the  analysis  of 
variance  table  is  evaluated  as 


Source 

Sums  of  Squares 

d.f. 

X2:  main  effect  of  A2 

SS(a(X2))  =  “[a2(l))^ 

rank  2  (X2)  =  1 

X3 :  interaction  A^  A2 

SS(a(X3))  =  ^[ai2(ll)]^ 

rank  I  (X3)  =  1 

Blocks 

B'K'*  B 

b-  1  =  2 

Error 

Y'Y-t'Q-  B'K'*  B 

w-rank  C  -  b  =  3 

Total 

Y'Y-  gVw 

7 

The  following  two  examples  have  been  extracted  fi:om  Davies  and  Zelen.'^  The  solutions 
are  given  in  abbreviated  form  somewhat  in  the  form  of  the  output  of  the  computer  program 
available  for  this  analysis.  Hopefully,  the  detailed  solution  for  the  prior  example  will  be  suf¬ 
ficient  to  make  clear  the  brief  annotations  to  these  examples. 

They  are  included  here  to  facilitate  the  relating  and  contrasting  of  the  solutions  using  the 
methods  of  this  paper  to  those  using  other  possible  techniques. 


“Davies,  0.  L.  (1967)  Design  and  Analysis  of  Industriol  Experiments,  Hofner  Publishing  Co.,  New  York,  466. 

M.  (1964)  Applicotions  of  the  Colculut  for  Factorial  Arrangements  II;  Unequal  Numbers  in  the 
Analysis  of  Variance,  MRC  Tech.  Summary  Repirt  411,  U.S.  Army  Math.  Res.  Center,  Univ.  of  Wise. 
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Example  2;  One-half  Fraction  of  2^  Design,  Davies 

Number  of  Factors  (n)  =  5  Number  of  treatments  (v)  =  32 

Factor  (A,  )/Levels  (m,)  Number  of  Blocks  (b)  =  4 

A,  2 

Aj  2 

A3  2 

A4  2 

Aj  2 


Treatment* 

Label 

Treatment  Combination 

(Iltl2«l3ll4«ls  ) 

Generalized 
Incidence  Matrix  (L*)* 

Vector  of 
Observations  (Y) 

2 

11112 

0  0  0  1 

Yj  4  ,  =  775 

3 

11121 

10  0  0 

^3.,..  =819 

5 

11211 

0  0  10 

Ys.j.  I  ~  •’93 

8 

11222 

0  10  0 

y,  j  ,  =878 

9 

12111 

0  10  0 

y,...!  =756 

12 

12122 

0  0  10 

yii.3,1  =745 

14 

12212 

10  0  0 

y.4  ,  .  =  785 

15 

12221 

0  0  0  1 

yi5:4;i  =851 

17 

21111 

10  0  0 

Yn.,..  =625 

20 

21122 

0  0  0  1 

y20.4..  =735 

22 

21212 

0  10  0 

=625 

23 

21221 

0  0  10 

^33  3..  =6^6 

26 

22112 

0  0  10 

y26.3.l  =666 

27 

22121 

0  10  0 

yj7.2.i  =841 

29 

22211 

0  0  0  1 

yj<».4.l  =628 

32 

22222 

10  0  0 

y32. 1. 1  =  732 

H*  =  l,j’  ;K  =  4I,;z,  =4jZj  =  16 

^Treatments  labeled,  1,4,6,7,10,11,13,16,18,19,21,24,25,28,30,  and  31  are  missing  from  the 
experiment. 


L*  =  L  with  rows  corresponding  to  missing  treatments  deleted. 

R*  =  R  with  rows  and  columns  corresponding  to  missing  treatments  deleted. 

C*  =  R*-  L*K**  l" 

^  I4  “  (^2  ""  -^2^  "  *^2^  ^2  *  ^^2  "  *^2^  ^^2  "  -^2^  ^  ^2 

^  j  “  (^2  '^2^  ^^2  ”  ^2^  ^  ^4  ^^2  "  ^2^  ^2  ^2  *  ^^2  "  -^2^ 

4  I2  H  (I2  -  J2)  (^2  “  '^2^  X  I2  ^  ^4  ”  ^^2  **  -^2^  ^  '^2  “  *^2^ 

(^2  “  J 2^  ''  ^2  ^2  ^^2  ”  *^2)  “  ^^2  ^  ^  ^^2  “  *^2^  ^  ^4 

C*  is  idempo^tint;  C**  =  C* 

Q*.  =  it*-L*K"‘b]'  =-j  [111,315,-288,412,-76,320,179,415,-461,-49,-600,-36,4,264,-477,-33] 
t»  =  C**  Q*  =  Q* 

Rank  C  =  v-  z,  -  Z3  =  12  =  degrees  of  freedom  for  treatments 
SS(t)  =  t* '  Q*  =  96951.5  •  t '  Q  =  treatment  sums  of  sqaures 

Note:  1.  The  starred  vectors  (matrices)  are  the  unstarred  counterparts  with  rows  (rows  and  columns) 
associated  with  missing  treatments  deleted.  The  deleted  rows  (rows  and  columns)  contain 
zero  elements  only. 

2.  Subscripts  on  partitions  of  C*  denote  the  dimensions  of  the  indicated  square  matrices. 
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Constraint  Matrix  U ' : 
Formed  so  that  U't  =  0  yieids: 


t3+ti4  +*32  =0 


Dependency  Relationships  fotind  from: 


Sul  ^ 


tg  +  tj  +  tjj  +  t  jj  =0 


*5  +  *12  +  *23  +  *26  "  ® 
*2  +  *15  +  *20  +  tjQ  =  0 


^3  =  0 

a„  (11)  =  0 


a,(l) 

a,(l) 

“3(1) 

a^d) 
asd) 
a, 2 (11) 
a=  a, 3  (11) 
a, 4  (11) 
a, 5  (11) 

aj4(ll) 

a34dl) 

a4sdl) 


■7  “  *10 

“  *11  ~  *13  “  *16 

=  0 

a3s  (11)  =  0 

~  *24  “ 

*25  “  *28  “  *30  ■ 

=  *31=0 

a, 23  (m)=-a4s(ll) 

Factors  Confounded 

a, 24  dll)  =  0 

Factors/Aliases 

With  Blocks 

A. 

^2 

A  A  A  A 

^  A  < 

A2A3 

ai3s(lll)  =  -a34(ll) 

A  <S  ^  9 

AjAaA.Aj 

A2A5 

a, 34  (111)  =  0 

A3 

AiAjA^Ag 

A3A5 

a,3sdll)=-a24(ll) 

A4 

As 

A,A2A3Aj 

A1A2A3A4 

A1A2A4 

A1A3A, 

a„g(lll)  =  0 

A.A, 

A3A4A5 

A1A4A5 

a33,(lll)  =  -a,5(ll\ 

A, A3 

A2A4A5 

AjAjAjA^  Aj 

a„5(lll)  =  -ai4(ll) 

A, A, 

AjAj 

A2A3A3 

A2A3  A4 

*■245  (111)  =  ~^13  (11) 

A2A4 

A 1A3AS 

’^345(111)  =  -»12dl) 

A3A4 

Aj  A2A5 

®  1234  (1111)  ~  ”a5(l) 

A4A5 

Aj  A2A3 

®  1235  (1111)  “  "  *>4(1) 

^  1245  (1111)  “  "ag  (1) 

a,3„(llll)  =  -a2(l) 

»  2345  (1111)  =  -^1(1) 

^12345  (11111)  "  0 

36 


Source  of  Variation 

Analysis  of  Variance  Table 

Sums  of  Squares 

Degrees  of  Freedom 

A. 

30102.25 

1 

Aj 

5550.25 

1 

A3 

2862.25 

1 

A4 

40401.00 

1 

As 

1849.00 

1 

A,Aj 

1482.25 

1 

A.A3 

3540.25 

1 

A,A4 

81.00 

1 

A, A3 

1521.00 

1 

AjA^ 

1156.00 

1 

A3A4 

1764.00 

1 

A4A5 

6642.25 

1 

Blocks 

26554.25 

3 

Total 

123505.75 

15 

^  Rows  and  colunms  of  V  associated  with  elements  of  a. 


37 


EXAMPLE  3:  A  3  x  2  x  2  FACTORIAL  WITH  UNEQUAL  NUMBER,  ZELEN” 
Number  of  Factors  (n)  =  3  Number  of  Treatments  (v)  =  12 

Factor  (A,  )/Levels  (m^)  Number  of  Blocks  (b)  =  1 


Treatment 

Treatment  Combination 

Generalized 

Vector  of 

Label 

(i1.i2.i3) 

Incidence  Matrix  (L) 

Observations  (Y) 

1 

111 

1 

y....i 

=  5 

2 

112 

1 

y2.,.i 

=  5 

3 

121 

2 

^3.1.1 

=  10 

^3.1.2 

=  12 

4 

122 

2 

^4.1.1 

=  13 

^4.1,2 

=  17 

5 

211 

1 

^S.l.l 

=  9 

6 

212 

1 

^6.1.1 

=  9 

7 

221 

1 

yr.i.i 

=  7 

8 

222 

2 

^8.1.1 

=  14 

^8. 1.2 

=  16 

9 

311 

3 

yo.i.i 

=  9 

^9.1,2 

=  13 

^9. 1,3 

=  8 

10 

312 

1 

y 

=  10 

11 

321 

1 

^11.1.1 

=  12 

12 

322 

1 

^12.  1. 1 

=  12 

R  =  (iiag  (1  1221112311  1) 
K  =  17 

Zj  =  1;  Zj  =  0 


'^Zelen,  M.  (1964)  Applications  of  the  Calculus  for  Factorial  Arrongemants  II:  Unequol  Numbors  in  the  Anoly 
of  Variance,  MRC  Tech.  Summary  Report  41),  U.S.  Army  Moth  Res.  Center,  Univ.  of  Wise. 


17  I,  -  J, 


(-  2I2:  -  Jla) 


-  2J2 


34I2-4J2  -2J2,3  (-4I2:  -6I2) 


I7I3-J3  (-2l3:-3l3) 


C=  R-LK'‘  L'  =  i. 


30  -6^ 


42/  \  -  31'^ 


(-2l3:-3l3)  I7I3-J3 


C  is  not  idempotent. 


I  864  12  -  85  J2  -49J2 
-49J2  432I2-I3J2 


(-  49I2:  -  37 12) 

(-  I3I2;  -  I2) 


-85  J. 


-49  J. 


864I3-85J3  (- 49I3:  -  37I3) 


-  131^) 


-  49 13 


419  -  r 


491;5> 


-  1  299> 


\-371^y 


85  J3.: 


-49  J3,2 


-85  J3 


(- 49I3:  -  37I3)  864I3-85J3 


Q’  =(T-  LK'‘B)'  = 


=  —(-96  -96  12  148  -28  -28  -62  148  -33  -11  23  23) 


t'=  (C*  Q)‘  =  (-5  -5  1  5  -1  -1  -3  5  0  0  2  2) 


Rank  C  =  V  -  Zj  -  Zj  =  11  degrees  of  freedom  for  treatments 


SS{t)  =  t'  Q  =  163.882 


Levels  of 

Factors  Interaction  E^ect  Vectors 


1 

2 

3 


-1 

0 

1 


^12 

^13 

^23 

11 

■-2‘ 

■  O' 

■  1' 

12 

2 

0 

-1 

21 

1 

-1 

-1 

22 

-1 

1 

1 

31 

1 

1 

32 

-1 

-1 

111 

112 

121 

122 

211 

212 

221 

222 

311 

312 

321 

322 


®^123 

0 

0 

0 

0 

1 

-1 

-1 

1 

-1 

1 

1 

1-1 . 


a(X)  =  M(X)t/v 


a  = 


a,(l) 

a,  (2) 
a,(l) 
a3(l) 

a, 2  (11) 
a,  2  (21) 
a, 3  (11) 

a, 3  (21) 


a 


a 


V/o-2  =  2!^  = _ L_ 

864 


59 


23 

-22 

-1 

-10 

7 

-7 

2 

-22 

14 

-10 

8 

-2 

2 

-16 

-5 

4 

7 

-2 

-1 

1 

10 

7 

-2 

-5 

4 

5 

13 

4 

113 

-58 

-7 

2 

1 

-1 

-10 

122 

2 

-16 

10 

-10 

8 

113 

-58 

13 

23 

-22 

122 

4 

-22 

14 

59 

-5 

4 

113 

-58 

122 

Design  is  not  orthogonal. 

ss[.(x,j]  =  r(x,)  l(x,^)-'l(x,  ) 


Degrees  of  freedom  for  a 


Source  of  Variation 
A, 


AjAjAj 

Error 

Total 


N  - 


Rank  1 


Analysts  of  Variance  Table 

Sums  of  Squares 

10.114 

58.576 

14.644 

30.591 

9.368 

14.644 

9.368 

26.000 

189.882 


j  =  1,  2 . 7 


Degrees  of  Freedom 


^  Rows  and  columns  of  V  associated  with  elements  of  a. 
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